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Stochastic entropy production arising from nonstationary thermal transport 
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We compute statistical properties of the stochastic entropy production associated with the non¬ 
stationary transport of heat through a system coupled to a time dependent nonisothermal heat bath. 

We study the one-dimensional stochastic evolution of a bound particle in such an environment by 
solving the appropriate Langevin equation numerically, and by using an approximate analytic so¬ 
lution to the Kramers equation to determine the behaviour of an ensemble of systems. We express 
the total stochastic entropy production in terms of a relaxational or nonadiabatic part together 
with two components of housekeeping entropy production and determine the distributions for each, 
demonstrating the importance of all three contributions for this system. We compare the results 
with an approximate analytic model of the mean behaviour and we further demonstrate that the 
total entropy production and the relaxational component approximately satisfy detailed fluctuation 
relations for certain time intervals. Finally, we comment on the resemblance between the procedure 
for solving the Kramers equation and a constrained extremisation, with respect to the probability 
density function, of the spatial density of the mean rate of production of stochastic entropy. 


I. INTRODUCTION 

It is quite apparent that the macroscopic world largely 
operates in an irreversible fashion, to the extent that the 
underlying time reversal symmetry of the laws of physics 
is often obscured. Processes at the macroscale typically 
evolve spontaneously in a specific direction and not in 
reverse, unless driven to do so by external control. It 
is very straightforward to list examples of irreversibility: 
heat flow, chemical reaction, particle diffusion, decay of 
coherent motion, inelastic collisions, brittle fracture and 
a host of other phenomena of a dissipative character. The 
triumph of thermodynamics, from its emergence in the 
19th century up to the present day, is to interpret all 
these phenomena as aspects of the second law. 

Recent studies of irreversible processes at the micro¬ 
scopic level have revealed a richer meaning of the tradi¬ 
tional second law and of the associated entropy produc¬ 
tion that quantifies the irreversibility of a given process 
mi- At microscopic scales, it is clear that a process can 
evolve both forwards and backwards as a result of spon¬ 
taneous fluctuations in the system or its environment. 
A sequence of improbable but not impossible collisions 
between molecules can drive a reaction from products 
back into reactants for a short time, or a particle up in¬ 
stead of down a concentration gradient. Developments 
in the thermodynamics of small systems in recent years 
have made it possible to incorporate this transitory be¬ 
haviour into the same framework that accounts for the 
much more clearly irreversible processes operating at the 
macroscale. This broader viewpoint can be expressed 
through a framework of deterministic dynamics EE], 
or alternatively by using the concepts of stochastic ther¬ 
modynamics EIBHII], where phenomenological noise is 
introduced into the dynamics of a system coupled to an 
environment in order to account for and to quantify dis¬ 
sipative behaviour. 

The stochastic entropy production that features in this 
latter approach is defined in terms of the relative likeli¬ 
hood that a system should evolve along a particular path 


or along its reverse. This quantity has received consider¬ 
able attention, particularly studies of the way its statis¬ 
tics are governed by identities known as fluctuation rela¬ 
tions mni. For example, while the stochastic entropy 
production can be both positive and negative as a system 
evolves, it satisfies an integral fluctuation relation which 
implies that its expected rate of change is non-negative 
when averaged over many repeated trials of the stochastic 
dynamics, real or imagined. When fluctuations are small, 
departures from the second law are rare, but excursions 
away from mean behaviour can be substantial for small 
systems or for short processes, and the rules that govern 
this behaviour extend the meaning of the second law at 
such scales. 

Traditionally there has been just one measure of ir¬ 
reversibility: thermodynamic entropy production, and 
many studies have investigated its evolution in systems 
subject to dissipation, e.g. Ham. In stochastic thermo¬ 
dynamics, however, it has been possible to define com¬ 
ponents of entropy production associated with different 
aspects of irreversibility, each possessing specific proper¬ 
ties [TSl - EO] . For example, the irreversibility of the cool¬ 
ing of a saucepan of hot soup differs somewhat from the 
irreversibility of the steady transport of heat from a hot 
plate through the saucepan and into the surrounding air 
that can maintain the soup at a desired temperature. 
Both are associated with the production of thermody¬ 
namic entropy: in the first case it may be described as 
relaxational, while in the second it has been referred to as 
housekeeping production required to maintain a steady 
state 111]. In stochastic thermodynamics each of these 
modes of entropy production has been quantified in terms 
of the underlying dynamics of a system coupled to an en¬ 
vironment. Analysis has shown, however, that two com¬ 
ponents are not always sufficient, and the housekeeping 
element can separate into two parts, one of which has a 
transient nature |18fED] . Systems driven by a time de¬ 
pendent environment under constraints that break the 
principle of detailed balance in the underlying dynamics 
will evolve irreversibly in a fashion characterised by three 
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components of stochastic entropy production. A similar 
conclusion was later reached by | 12 ] but with an alterna¬ 
tive choice of representation. In this study we investigate 
the statistics of the three contributions for a simple case 
of thermal transport. 

In Section]^ we introduce the system of interest, a sin¬ 
gle particle performing underdamped Brownian motion 
in a confining potential while coupled to a nonisother- 
mal environment characterised by a time and space de¬ 
pendent temperature. After defining the components of 
stochastic entropy production, further details of which 
are given in Appendix we employ in Section |III| an 
approximate solution to the Kramers equation describ¬ 
ing the evolution of an ensemble of such systems, derived 
in Appendix^ to quantify the mean behaviour of each 
contribution. We note in Appendix [C] that the solution 
method resembles the constrained extremisation of the 
spatial density of the mean rate of production of stochas¬ 
tic entropy [23H25] . analogous to Onsager’s principle [26], 
although the interpretation is not unproblematic. In Sec¬ 
tion [TV] we generate individual realisations of the motion 
using a Langevin equation in order to obtain the distri¬ 
bution of fluctuations of stochastic entropy production 
about the mean. Our particular aim is to demonstrate 
the importance of the transient component of housekeep¬ 
ing entropy production. We also demonstrate that as 
long as the friction coefficient is not too small, the to¬ 
tal entropy production as well as its relaxational com¬ 
ponent satisfy detailed fluctuation relations for certain 
time intervals and driving protocols, and in Appendix 
[D] we perform an analysis to provide an understanding 
of this behaviour. This is a demonstration that an un¬ 
derlying exponential asymmetry in the production and 
consumption of entropy can be made apparent as long 
as the conditions are chosen carefully. In Section |V| we 
present our conclusions. 


II. STOCHASTIC THERMODYNAMICS IN A 
NONISOTHERMAL ENVIRONMENT 

A key aspect of stochastic thermodynamics is that it 
provides a link between thermodynamic concepts, such 
as entropy production, and a description of the mechan¬ 
ical evolution of a system. The stochastic nature of the 
dynamics is important in that it ties in with an inter¬ 
pretation of entropy production as the progressive loss 
of certainty in the microscopic state of a system as time 
progresses. Such loss is perhaps more fundamentally a 
consequence of a sensitivity to initial conditions within 
a setting of deterministic dynamics, together with the 
difficulty in preparing a system in a precise initial state, 
but introducing phenomenological noise into a stream¬ 
lined version of the dynamics has a similar effect. Ther¬ 
modynamics is the study of the behaviour of a system 
in an environment where some of the features are speci¬ 
fied only approximately (this is particularly the case for 
the environment). We therefore expect any modelling 


approach to have limited predictive power. In stochastic 
thermodynamics it turns out that stochastic entropy pro¬ 
duction, operationally defined in terms of certain energy 
exchanges, embodies this predictive failure. It is striking 
to conclude that microscopic uncertainty may essentially 
be measured using a thermometer, and that an appar¬ 
ent determinism in the form of the second law for large 
systems can emerge from a fundamentally underspecified 
dynamics. It seems that one of the few matters about 
which we can be certain, in such a situation, is that mi¬ 
croscopic uncertainty should increase. 

We focus our discussion on the one-dimensional (1-d) 
motion of a particle coupled to a nonisothermal environ¬ 
ment, described by the following stochastic differential 
equations (SDEs): 


dx = vdt, 

Fix') 

dv = —^vdt H- -dt + 

m 


/ 2kTr{x,t)^ \ 
\ m J 


( 1 ) 

1/2 

dW, (2) 


where x and v are the particle position and velocity, re¬ 
spectively, t is time, 7 is the friction coefficient, F{x) 
is a spatially dependent force field acting on the parti¬ 
cle, assumed to be related to a potential (/'(a;); m is the 
particle mass, Tr{x,t) is a space and time dependent en¬ 
vironmental temperature and dW is an increment in a 
Wiener process. Eq. © is to be interpreted using Ito 
rules of stochastic calculus illlMi. 

We should note that heat baths are normally regarded 
as having static thermal properties, so the time depen¬ 
dence of Tr is to be interpreted as the sequential decou¬ 
pling and recoupling of the system to reservoirs at slightly 
different temperatures. The effect of an evolving thermal 
environment on a system can then be taken into account, 
retaining the essential requirement that heat exchanges 
with the system should not affect the properties of the en¬ 
vironment. It should be noted that a similar framework 
for discussing an evolving environmental temperature in 
stochastic thermodynamics has recently been presented 
|29| . Indeed the above SDEs, often with a constant 
and in the overdamped limit, have been used a starting 
point for discussing a great number of characteristics of 
irreversible behaviour. 

Following Seifert |3|, stochastic entropy production is 
defined as a measure of the probabilistic mechanical ir¬ 
reversibility of the motion. The dynamics generate a 
trajectory a;, v (x represents a function x{t) in the time 
interval 0 < < < r and v its time derivative) under a 
‘forward’ driving protocol of force held and temperature 
evolution. In Eq. (§ the protocol is a specification of the 
time dependence of Tr- The likelihood of the trajectory is 
specified by a probability density function P^[£, v] writ¬ 
ten as a product of the probability density of an initial mi¬ 
crostate p{x = x{0),v = v{0),t = 0) = 
and a conditional probability density V for the subse¬ 
quent trajectory. The dynamics can also generate an an¬ 
titrajectory initiated after an inversion of the particle ve¬ 
locity at time r, and driven by a reversed time evolution 
of the force held and reservoir temperature (71 [ 111130 ], 
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until a total time 2t has elapsed. Evolution in this in¬ 
terval T < t < 2t is described by a probability den¬ 
sity for an antitrajectory starting at 

x{t), —v{t) and ending at a;(0),—u(0), with the super¬ 
script R indicating that the potential and reservoir tem¬ 
perature evolve backwards with respect to their evolution 
in the time interval 0 < t < t P^l - EO] . The total entropy 
production associated with the trajectory x, v is then 
defined by 


Astot [x, v] = In 


P^[S, u] 


( 3 ) 


and the key idea of stochastic thermodynamics is that 
after multiplication by Boltzmann’s constant and a pro¬ 
cedure of averaging over all realisations of the motion, 
this should correspond to the change in traditional ther¬ 
modynamic entropy associated with the forward process. 

For the system under consideration, the stochastic 
entropy production as the particle follows a trajectory 
evolves according to the SDE 


dAstot = -d[\Tip{x,v,t)]- 


kTr{x, t) 


mv 




F{x)dx 


kTr{x, t) 

( 4 ) 

The derivation of this expression starting from the 
stochastic dynamics in Eqs. Q and ([^ is discussed in 
more detail in Appendix]^ The second and third terms 
are negative increments in the kinetic and potential en¬ 
ergy of the particle over the time interval dt, both di¬ 
vided by the local reservoir temperature. Together, they 
represent an increment in the energy of the environment 
(a heat transfer dQr) divided by the local temperature, 
therefore taking the form of an incremental Clausius en¬ 
tropy production dAsr = dQr/kTr{x,t). The first term 
in Eq. Q is the stochastic entropy production associated 
with the particle over the time interval. Seifert defined a 
stochastic system entropy Sgyg = — \np{x, v,t) in terms of 
the phase space probability density function p generated 
by the stochastic dynamics [3], such that we can write 
dAstot = dAssys + dAsr- As the particle follows a tra¬ 
jectory, it moves through a probability density function 
p{x, V, t) that represents all the possible paths that could 
have been followed, and the system entropy production 
emerges from a comparison between the actual event and 
this range of possible behaviour. The evaluation of Astot 
for a specific realisation of the motion therefore requires 
us to determine the probability density function (pdf) by 
solving the appropriate Kramers equation m 


dp dJ " dp F dp 

corresponding to the SDEs in Eqs. Q and ([^, where 
J),’’ = —^vp — d{Dyp)/dv, with Dy = 'ykTr{x,t)/m, is 
the irreversible probability current for this system, re¬ 
sponsible for the growth of uncertainty and hence mean 
stochastic entropy production. 


In spite of the fluctuating nature of the total stochas¬ 
tic entropy production, the expectation of this quantity 
is non-negative. This may be expressed as d(Astot) = 
d(Assys) + d{Asr) > 0 where the brackets denote an av¬ 
erage over the distributions of system coordinates at the 
beginning and end of the incremental time period. Note 
that for economy the qualifier ‘stochastic’ is henceforth to 
be implied rather than stated when referring to entropy 
production. 

We now separate the entropy production into compo¬ 
nents, each with a particular character, along the lines 
of initial developments by Van den Broeck and Esposito 
HMZl and extended by Spinney and Ford [ISfEO] , using 
a framework suggested by Oono and Paniconi |^. The 
total entropy production may be written as three terms 

naisi 


dAstot = dAsi -I- dAs2 + dAs^, (6) 


with the Asi and As 2 components defined in terms of 
ratios of probabilities that specific trajectories are taken 
by the system, in a manner similar to Eq. Details 
are to be found elsewhere |18lEn] and in Appendices 
and 1^ Note that there is no implication of a one-to-one 
correspondence between the Asi _3 and the three terms 
in Eq. Q. 

The evolution of the average values of the components 
may be related to the transient and stationary system 
pdfs {p and pst, respectively) according to 


d{Asi) 

dt 

d{As2) 

dt 

djAss) 

dt 


P 


dxdv 


Dy 


1" 

U 


7“ 

u 


p 


Pst 




Dy 


- f dxdv ^ In 

./ dt 


Pstix, -V) 
Pst{x,v) 


> 0 , 


> 0 , 


Pstix, -V) 


( 7 ) 

( 8 ) 
( 9 ) 


where Cpst = 0, and = —^vpst — d{DyPst)/dv is the 
irreversible probability current in the stationary state. 
The mean rate of total entropy production is 


Astot) 

dt 


= / dxdv 


DyP 


> 0 . 


( 10 ) 


The three contributions to the total entropy production 
can be interpreted as follows. Asi is the principal re- 
laxational entropy production associated with the ap¬ 
proach of a system towards a stationary state. Its av¬ 
erage over all possible realisations of the motion, namely 
(Asi), increases monotonically with time until stationar- 
ity is reached, since d{Asi)/dt —>■ 0 as p —?► Pst- Esposito 
and Van den Broeck [Mn] denoted it the nonadiabatic 
entropy production. 

As 3 is also associated with relaxation, but in contrast 
to Asi no definite sign can be attached to d{Asz)/dt. 
However, if the stationary pdf is velocity symmetric As 3 
is identically zero. Since a velocity asymmetric stationary 
pdf is typically associated with breakage of a principle of 
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detailed balance in the stochastic dynamics HMZI, this 
component arises in situations where there is a nonequi¬ 
librium stationary state involving velocity variables. It 
was designated the transient housekeeping entropy pro¬ 
duction by Spinney and Ford |18| . 

As 2 is also associated with a nonequilibrium station¬ 
ary state, since its average rate of change in Eq. ([^ 
requires a non-zero current in the stationary state. 
The mean entropy production rate in the stationary state 
is represented by d{As 2 ) /dt alone, and this is non-zero 
only if the stationary current is non-zero. Esposito 
and Van den Broeck referred to As 2 as the adiabatic en¬ 
tropy production and considered it in the context of the 
dynamics of spatial coordinates, and Spinney and Ford, 
who considered velocity variables as well, denoted it the 
generalised housekeeping entropy production. 

For a nonisothermal, time dependent environment we 
expect all three kinds of entropy production to take place. 
The mean rates of production for each component are 
examined next, and in Section |IV| we shall consider the 
distributions of fluctuations about the mean. 


III. MEAN STOCHASTIC ENTROPY 
PRODUCTION 


Tr{x,t) = T,?(a;)[I -I- g{t)], but not so violently that p is 
significantly disturbed from its profile when g = 0. We 
write pv^(x,t) = pv^ -I- pkTj./m + f dvv^fip, and antici¬ 
pating that the final term is of order 7 “^ we deduce that 
pv"^ « pkT^/m for the stationary case where u = 0 and 
g = 0, so that Eq. (El reduces to 


k 


d{PstT°) 

dx 


Fpst 


0 , 


(14) 


in which case 


Pst{x) oc 


1 

TO 


exp 



dx' 


Fix') \ 

kT0{x')) ’ 


(15) 


is the approximation we shall employ for the spatial dis¬ 
tribution p. 

The Kramers equation is 


dp 


dp 


F _\ dp 

- 'y'''I IT 

m J dv 


kTr^ d f r dll’ 
m dv \ dv 


, (16) 


and we set u = 0 and expand the distribution p = fil+ip) 
as a series in 7 “ ^. The leading term p « / is independent 
of 7 and we write 

,/, = 7-1')/,;^+7-2^2 H-, (17) 


We are concerned with the 1-d Brownian motion of 
a particle in a potential under the influence of a back¬ 
ground temperature that varies in space and time. 
The pdf pix,v,t) evolves according to Eq. (|^ subject 
to a requirement that p, dpjdv and dp/dx all vanish as 
x,v —i' ±00 for all t. We shall use an established per¬ 
turbative method 1131311 [S3] to obtain an approximate 
expression for p to leading order in the inverse friction 
coefficient. 

Integration of the Kramers equation with respect to v 
yields the continuity equation 


^ djpv) 

dt dx 


( 11 ) 


where we define p{x^t) = J dvp and pu"(a;,t) = f dvv"'p, 
and multiplication by v followed by integration gives 


d{pv) d{pv'^) 
dt dx 


F 

— P = -IPV, 


( 12 ) 


which is a momentum transport equation. We represent 
the pdf in the form p = /(I -|- ^p) with 


f{x,v,t) = p 


m 


2TTkTr 


exp -- 


m{v — v)^ 
2kTr 


(13) 


such that J dvf'tp = 0 and f dvvf'tp = 0. We further sim¬ 
plify the situation by requiring that the time dependence 
in the pdf is confined to the distribution over velocity. 
The spatial pdf p is therefore time independent which 
in turn implies that the mean velocity v is zero, accord¬ 
ing to Eq. ( |TT| . We study situations where the back¬ 
ground temperature is driven in a cyclic manner with 


with each contribution ipi satisfying J dvf'iF = 0 and 
J dvvf'ipi = 0. Gathering all terms in Eq. ( [l^ of order 
zero in 7 “^ and setting u = 0 leads to 


^ F9/ ^ kTr-i d 
dt dx m dv m dv 


djl Vi) 

dv 


(18) 


and by solving this for ipi, the representation of p that 
emerges will be correct to first order in 7 “^. 

It is possible to obtain a solution to Eq. (18 1 using 


a variational procedure that is described in more detail 
in Appendix and to argue that the identification of p 
resembles a principle of constrained extremisation of the 
spatial density of the mean rate of entropy production 
specified to first order in the inverse friction coefficient 
(see Appendix]^. Here it is sufficient to state that Eq. 
is satisfied by Eq. (13) with u = 0 and with 


7 = tpQ + av + bv"' + cv"^ 


where 


a = 


1 dTr 
27fy.^’ 
m dTr 


b=- 


dTr 


c = — 


6^kT^ dx 


V'o = 


47fcr2 dt ’ 
1 dTr 


A'yTr dt 


(19) 


( 20 ) 


such that upon insertion of Eq. (191 into Eq. (18 1 the 


coefficients of terms proportional to powers of v vanish. 
The evolving pdf is therefore specified by 


pix,v,t) 


1 -k 


1 dTr 


1 dTr 


i'yTr dt 2'yTr dx 
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5T, 


A'jkT^ dt 


r 2 
V — 


dT, 


6^kT^ dx 




^Pst{x) 


m 


2'KkTr 


exp - 


mv 

2kTr 


( 21 ) 


to first order in 7 and the stationary pdf for a given 
temperature profile is 


Pstix,v) 


1 + „ „ —— V — 


dT, 


2"fTr dx Q^kT^ dx 




X Pstix, 


/ m 
Y 2'KkTr. 


exp - 


mv 

2kTr 


■ ( 22 ) 


Now we can evaluate the mean rate of change of each 
component of entropy production. Most straightfor¬ 
wardly, from Eqs. ([^ and (22 1 we have 


dt / dt 


1 _|_ 1 —^ 1 ;_ ™ 9Tr 3 

^ 2'fTr. dx d'ykT^ dx 


1 - 


1 dTr- 

2 'yTr dx 


m. dTr 3 

67/CT2 dx 


(23) 

The logarithm is an odd function of v and its leading 
term is proportional to 7 “^, and furthermore, according 
to Eq. (21 1 , dp/dt is an even function of v to zeroth order 
in 7 “^, so we conclude that (AS 3 ) « 0 to order 7 “^. 

The irreversible probability current is 

k 


nr _ 


2m 

X Pst (a::) 


dTr 

dx 


m dTr m dTr 2 

kTr dt kTr dx 


m 

2KkTr 


exp 


mv 

2kTr 


(24) 


so that from Eqs. (| 8 |) and (|24| we have 

d{As2) 


dt 


dxdv 


kf 

A'jmTr 


(dTr 

^ 2 

^ dx 

1 - 

kTr 


= dx 


kps- 


2'ymTr \ dx 


dTr 


(25) 


to first order in 7 Finally, from Eqs. Q and (241 we 
deduce that 


d{Asi) 

dt 


« J dxdv 
= dx 


fm 

'ykTr 

Pst 


47 T 2 


tm 

~di 


1 dTr 
Wrlh 
2 


(26) 


such that 

d{Astot) ^ 
dt 


dx 


2mjT, 


' Pst 


m 

2kTr 


dTr 

Ih 


dTr 

dx 


(27) 

which can also be obtained by the direct insertion of 
Eqs. ( [ 2 TI and (241 into Eq. (10). The relaxational 
and housekeeping (nonadiabatic and adiabatic in alter¬ 
native terminology) components of the mean rate of total 



Figure 1. Spatial trajectory of a particle according to stochas¬ 
tic dynamics in the presence of an environment where the tem¬ 
perature varies in time and space, illustrated by the text and 
background colours. The evolution of the stochastic entropy 
production Astot associated with the Brownian trajectory is 
sketched in the inset. 


entropy production, to leading order in 7 “^, are clearly 
never negative and can be seen to arise from the temporal 
and spatial dependence, respectively, of the environmen¬ 
tal temperature. For dTr/dt = 0, Eq. (27) reduces to 
an expression employed previously in studies of entropy 
production in a time independent nonisothermal system 

[iniisi]- 


IV. DISTRIBUTIONS OF STOCHASTIC 
ENTROPY PRODUCTION 

We now turn our attention to fluctuations in the pro¬ 
duction of stochastic entropy away from the mean be¬ 
haviour determined in the last section. We solve the 
SDEs ([^ and ([^ to generate a trajectory of particle po¬ 
sition and velocity and then insert the pdf specified in 
Eq. into Eq. 0 to obtain the associated evolution 
of total entropy production Astot- This is illustrated in 
Figure ^ where a particle follows a Brownian trajectory 
while coupled to an environment with a temperature that 
varies in space and time, represented by the background 
colours. The evolution of Astot is stochastic, but with a 
distinct upward trend. 

We choose simple forms of the potential and thermal 
background that the particle experiences. We consider a 
harmonic force F{x) = —kx where k is a spring constant, 
and an environmental temperature that varies in space 
and time according to 

Trix,t) = Toil + KT{t)xyi2kTo)], (28) 

where Tq is a constant and the time dependence is speci¬ 
fied by Krit) = + B sinojt > 0 with constant B. Four 

cycles of such behaviour are sketched in Figure The 
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Figure 2. A comparison between the mean total stochastic 
entropy production obtained from the integral of the approx¬ 
imate Eq. ( |27[ ) and the total stochastic entropy production 
averaged over 2 x 10^ numerically generated particle trajecto¬ 
ries, each with 40000 timesteps, shown with error bars. The 
time interval represents two cycles of temperature variation, 
preceded in the simulations by one cycle to establish an evolv¬ 
ing pdf similar to Eq. (|21[). 


environment is hotter as the distance from the particle 
tether point increases, and the spatial temperature pro¬ 
file varies sinusoidally with time. We expect heat to be 
carried by the particle, on average, from sources located 
away from the tether point towards sinks situated near 
the centre of the motion. The average rate of flow of heat 
should be affected by the time dependence of T^. 

This choice of profile implies that T°(x) = To[l -I- 
k^x^/(2A:To)] and we evaluate the integral 


F{x) 


lo 


L ""Siii 

.0 


! {2kT{))] 


= - (k/kt) ln[l + 4a:V(2fcTo)], (29) 

such that the normalised stationary spatial pdf according 
to Eq. (151 is 


Pst{x) = 


r (i -f 

V 27rfcTo J r (i -I- k/k^) 




K-O 

r\jrp Q 

2kTn^ 


and furthermore we can write 


dTr X 


and 


dTr 


dnxit) x^ 
dt 2k ’ 


—1—kI h 


(30) 


(31) 


(32) 


which fully specifies the evolution of (Astot) given in Eq. 
(271. A similar system with time-independent was ex¬ 
amined in |35| for the purpose of deriving work relations 
under nonisothermal conditions. 

For the numerical computation of the total entropy 
production we integrate 


dAstot = -d[lnp] - 


m 


j r 21 ^^7 

2kTr^ 


(33) 


Figure 3. Comparison of the average of Asi predicted analyt¬ 
ically and calculated from the simulation of 2 x 10^ particle 
trajectories over a time interval of two temperature cycles pre¬ 
ceded by one cycle to establish the periodic stationary state. 



Figure 4. As Figure but for the average of As 2 . 


along with the SDEs for x and v, and the components of 
entropy production evolve |19| according to 


dAsi = -d[lnp] -I- d[lnpst], (34) 

dAs3 = -d[\iipst{x, u)] -I- d[ln(pst(a^, -v)], (35) 


together with dAs 2 = dAstot ~ dAsi — dAs^. 

We select initial coordinates from the stationary pdf 
Pst{x,v) specified by Tr(x), the temperature profile at 
t = 0, and evolve the system over a time interval 0 < 
t < GTrjuj corresponding to three cycles of variation in 
the temperature profile, with parameters w = 8, m = 1, 
kTg = 1, K = 1, = 0.5, B = 0.2, and 7 = 60. The 

short relaxation time 7“^ relative to the cycle period 
2tt juj ensures that the dynamics do not depart very far 
from the overdamped limit such that the expressions for 
p and Pst given in Eqs. (211 and (22) are reasonably 
accurate. 

The interval is divided into 40000 timesteps of length 
5t = 5.89 X 10“^ and samples of entropy production are 
generated from 2 x 10^ realisations of the Brownian mo¬ 
tion. The system relaxes quickly into a periodic station¬ 
ary state but we disregard behaviour taking place in the 
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first cycle Q < t < 2tt/oj and focus our attention on en¬ 
tropy production during the second and third cycles. 

We gauge the quality of the numerical calculations by 
checking that (Astot) matches the evolution obtained 
from integrating the approximate analytical expression 
{27 Statistical uncertainty in the numerical results is 
assessed by blocking the realisations into 40 subsets, and 
the resulting error bars in Figure show that the accu¬ 
racy of the numerical approach is satisfactory. Similar 
conclusions are reached by determining the evolution of 
(Asi) by the analytic and numerical routes, illustrated 
in Figure and a similar procedure for (AS 2 ) in Figure 
1^ The different character of these two components of 
entropy production is apparent. There are two bursts of 
relatively rapid mean production of Asi per cycle. The 
system responds to the raising and lowering of the tem¬ 
perature profile and relaxational entropy generation is 
associated with both. In contrast, the time development 
of (AS 2 ) more closely matches the periodicity of the tem¬ 
perature cycle, since it is a reflection of the entropy pro¬ 
duction that would characterise a stationary state for a 
given nonisothermal profile. 

The Asi and As 2 components of entropy produc¬ 
tion, as well as Astot, satisfy an integral fluctuation 
relation (exp(—As^)) = 1 by construction for any 

elapsed time interval HSl [IS]. We can demonstrate 
further that a detailed fluctuation relation P(Astot) = 
P(—Astot) exp(Astot) appears to be satisfied by Astot 
for certain time intervals, as illustrated in Figure We 
have chosen conditions where the initial and final system 
pdfs are the same, which will be the case for an inter¬ 
val that is a multiple of the cycle period 2tt/uj once the 
system has adopted a periodic stationary state; and for 
which the evolution of the environmental temperature 
profile is symmetric about the midpoint of the time in¬ 
terval, for example 77r/2a; < t < ll7r/2cij indicated by 
the horizontal bar in the inset shown in Figure These 
are circumstances where the total entropy production in 
a system described by spatial coordinates alone Enm is 
expected to satisfy a detailed fluctuation relation. The 
backward version of the process in this time interval is 
identical to the forward version. Detailed fluctuation re¬ 
lations relate distributions of entropy production in for¬ 
ward and backward processes but here the two are syn¬ 
onymous. For time intervals where this is not the case, 
for example Stt/w < t < Stt/w, the distribution of total 
entropy production will not satisfy a detailed fluctuation 
relation. 


For systems that possess velocity coordinates, a de¬ 
tailed fluctuation relation for Astot will be valid if, ad¬ 
ditionally, the initial pdf for the backward process is the 
time-reversed version of the initial pdf for the forward 
process. For such a relation to hold for our system, the 
pdf at the beginning and end of the cycle should be veloc¬ 
ity symmetric, as demonstrated in Appendix |D 1| This 
condition is not in general satisfied for a nonequilibrium 
system described by underdamped dynamics, but if the 
friction coefficient is not too small, the velocity asym- 



Figure 5. Numerical verification of an approximate detailed 
fluctuation relation for the pdf of total stochastic entropy 
production Astot in the time interval 7-k/ 2u) < t < ll7r/2a) 
(shown as a bar in the inset), driven by the change in tem¬ 
perature profile according to the evolving Krit). Values of 
Astot between ±0.2 from the simulation of 2 x 10^ particle 
trajectories are collected into 400 bins, and the straight line 
represents the outcome expected in the absence of sampling 
errors. 


metry in Eq. (211 is slight and the detailed fluctuation 
relation should hold to a good approximation. 

We found that the distribution of Asi over the same 
time interval 77r/2a; < t < ll7r/2a; also appears to sat¬ 
isfy a detailed fluctuation relation, as shown in Figure]^ 
while in contrast the distribution of As 2 does not possess 
such a symmetry, as illustrated in Figure In Appendix 
ID 21 we consider conditions for the existence of a detailed 
fluctuation relation for the Asi component of entropy 
production in general systems with spatial and veloc¬ 
ity coordinates. We conclude that P(Asi) will satisfy 
a detailed fluctuation relation if the friction coefficient is 
not too small, such that behaviour under the chosen sys¬ 
tem dynamics and its ‘adjoint’ version are simply related. 
A detailed fluctuation relation was observed for the to¬ 
tal entropy production in a stationary state of thermal 
transport in m, and this can now be interpreted as an 
approximate result. Furthermore, the conditions that al¬ 
low us to show that detailed fluctuation relations hold 
to a certain extent for P(Astot) and P(Asi) do not im¬ 
ply a similar property for P(As 2 ), as shown in Appendix 
|D 3[ allowing us to understand the contrast in behaviour 
between Figures and 

Distributions P(Asi) of the three components of en¬ 
tropy production generated over two cycles of the vari¬ 
ation in temperature profile, namely for the interval 
Stt/cli < t < Gtt/o;, together with the distribution of their 
sum Astot) are shown in Figure The fluctuations in 
the As 3 component are the smallest, but all contributions 
explore a broad range in comparison with their averages, 
which according to Figures and would be of order 
10“^ for (Asi) and (AS 2 ), together with (Asa) « 0. 

The second law in the stochastic framework corre¬ 
sponds to the non-negativity of the mean values of Astot j 
Asi and As 2 over distributions such as these. Although 










Figure 7. Demonstration that a detailed fluctuation relation 
does not appear to hold for As 2 in the interval 77r/2a; < t < 
U'k/2lu. 


the peak in the distribution of As 2 lies slightly to the left 
of the origin, its mean is positive as required. We have 
clearly demonstrated that there is considerable weight 
of probability for the generation of negative values of 
these quantities for this small system as it undergoes a 
short process. Nevertheless, such fluctuations are gov¬ 
erned by rules in the form of fluctuation relations of vari¬ 
ous kinds. We have also demonstrated that the transient 



Figure 8. Distributions of Astot, Asi, As 2 and Ass generated 
in two cycles of temperature variation 27r/a; < t < Gnjuj. 


housekeeping component of entropy production Asa as¬ 
sociated with the breakage of the principle of detailed 
balance in a system evolving in full phase space makes 
a significant contribution to the total stochastic entropy 
production. 


V. CONCLUSIONS 

The irreversibility of a stochastic process can be quan¬ 
tified through the consideration of three components of 
stochastic entropy production. In order to illustrate this 
we have studied the behaviour of a particle coupled to 
an environment characterised by a temperature that de¬ 
pends on time and space. The system is complex enough 
to manifest all three components of entropy production, 
and yet simple enough for us to obtain an approximate 
expression for the time dependent probability density 
function (pdf) of particle position and velocity that is 
required to perform the computations. In order to solve 
the Kramers equation and determine the pdf, we use a 
variational approach that resembles the maximisation of 
an Onsager function. Such an approach has been re¬ 
garded as the use of a principle of maximisation of the 
rate of thermodynamic entropy production under con¬ 
straints, but there is a certain ambiguity in the thermo¬ 
dynamic interpretation and we have discussed a point of 
view where it might instead be regarded as a constrained 
minimisation. A cautious thermodynamic interpretation 
is probably necessary. 

Mean relaxational or nonadiabatic entropy production 
(Asi) is driven by the time dependence of the environ¬ 
mental temperature, and arises from the tendency of the 
system to evolve towards a state of local thermal equi¬ 
librium with respect to the environment, which here is 
frustrated by the continual environmental change. Mean 
housekeeping entropy production (AS 2 ) is brought about 
by the spatial dependence of the environmental temper¬ 
ature, and is associated with the passage of heat, on av¬ 
erage, from hotter to cooler parts of the environment by 
way of the particle. We have provided analytic expres¬ 
sions, correct to first order in inverse friction coefficient, 
for the evolution of the mean values of Asi and As 2 . The 
mean of the third component, the transient housekeeping 
entropy production Asa, is zero at the level of approx¬ 
imation employed, and in order to compute a nonzero 
mean for this quantity we would need to determine the 
system pdf to second order in inverse friction coefficient. 
The Asa component contributes to the fluctuations in 
stochastic entropy production when the system is in a 
stationary state characterised by a velocity asymmetric 
pdf, and would be expected to have a nonzero mean when 
a system undergoes relaxation: it is therefore indicative 
of both relaxational and housekeeping behaviour. 

We have determined the distributions of entropy pro¬ 
duction for certain time intervals, and investigated situ¬ 
ations where both Astot and Asi satisfy a detailed fluc¬ 
tuation relation. Analysis given in Appendix [D] suggests 
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that As 2 does not have this property in the same circum¬ 
stances, and that the detailed fluctuation relations hold 
for the system and circumstances under consideration as 
long as the friction coefflcient is not too small. Detailed 
fluctuation relations are a rightly celebrated centrepiece 
of the thermodynamics of small systems, since they ex¬ 
press an asymmetry in the production and consumption 
of entropy, but they rely on the validity of certain initial 
and final conditions for the forward and backward pro¬ 
cesses considered, and we have illustrated this feature 
for a particular underdamped system. Finally, we have 
computed the distributions of the three components of 
entropy production, showing that in the case studied the 
As 3 component has a smaller variance than the other 
two. 

The basis of the second law in stochastic thermody¬ 
namics is the adherence of Astotj Asi and As 2 to in¬ 
tegral fluctuation relations, and we have succeeded in 
demonstrating the consequent monotonic increase in the 
mean values of these forms of stochastic entropy produc¬ 
tion for a system processed in a way that gives rise to 
nonstationary thermal transport. We have also clearly 
demonstrated the existence of the third component Ass 
in a situation where the stationary state of the system is 
asymmetric in velocity. These observations provide fur¬ 
ther illustration of the rich structure of stochastic ther¬ 
modynamics. 


Appendix A: Components of stochastic entropy 
production 

We summarise results that are derived in more detail 
in Spinney and Ford m, concerning the dynamics of 
components of stochastic entropy production. For Ito- 
rules stochastic differential equations (SDEs) 

dxi = Ai{x,t)dt + Bi{x,t)dWi, (Al) 

where x represents a set of dynamical variables 
(xi,X 2 , • • •) such as (a;, v), we define 

^ [Ai{x,t) +eiAi{ex,t)] = eiA-"'(£x, t), (A2) 

and 

AJ®''(x,t) = i [Ai(x,t) -e^At{£x,t)] = -eiA-®''(ex,<), 

where = 1 for variables x^ with even parity under time 
reversal symmetry (for example position x) and £j = — 1 
for variables with odd parity (for example velocity v), and 
ex represents (eixi, £ 2 X 2 , • • Defining also Di{x,t) = 
^Bi{x,t)^, it may be shown that the following Ito-rules 
SDE for the total entropy production (defined in Eq. @) 
emerges: 


_ Air ^rev^ir 

dAstot = -d(lnp) 4- ^ - ' ' 

jji Ui oyii 




dxi 

d^D 


Di 5xj 


D, 


5xj 


9x2 


(A4) 


where p is the time dependent pdf of variables x. The 
corresponding Ito SDE for the principal relaxational en¬ 
tropy production is 


dAsi =-d(lnp) - ^dxi - (A5) 

where p = — Inpst and pst is the stationary pdf. We also 
have 

/Iif 4 rev Air 

dAs 2 = ^2 - —dt + -J^dxi -I- £i(p'(ex)ds 


D, 


D,; 


^^'-dxi -f ^ + Di{ip[(ex)fdt 


Di dxi 


,9A 


-2enp'i{ex)-^dt + £i{A" - A’^^'')Lp[{£x)dt 
(Af - AD dD, 


D, 


dx. 


dt, 


(A6) 


specifying an increment in As 2 , using notation (^'(ex) = 
eidp[£x)/dxi and 

dAs3 = -dlnpst(x) -|- dlnpst(ex) 

= ^ (p'(x) o dxj — £j(p'(£x) o dxj, (A7) 


for the third component. Stratonovich notation is used 
in the second line for reasons of compactness, but a more 
elaborate Itb-rules version can be constructed. For the 
dynamics specified by Eqs. ([^ and (|^ we have = 0, 
A^"'' = V, D = -IV, A]r = F/m, A = 0 and A = 
kTrj/m and using Eq. (A4| we recover Eq. (§. 


Appendix B: Variational solution to the Kramers 
equation 


We wish to obtain a solution to the approximate 
Kramers equation 


dl 

dt 


dx 


F 


m 


df 

dv 


kTj.j d 
dv 


m 


that results from inserting Eq. (131 into Eq. 


d{l Vi) 

dv 

, (Bl) 
16|) without 


setting p = Pst or u = 0, and using the leading term in 
Eq. . For simplicity of notation we henceforth write 
^ The approach involves a variational princi¬ 

ple employed for a similar purpose by Kohler |23| , Ziman 
[24] and Cercignani |25|, and which has been discussed 
in a broader con text by Martyushev and Seleznev [36] . 
Casting Eq. (Bl I in the form Z = Lt/i where L is the lin¬ 


ear operator given by L(-) = {kTr^/m)d/dv{fd{-)/dv) 
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we seek a solution by extremising the functional 




(B2) 


over trial solutions ip that satisfy relevant constraints 
J dvfip = 0 and f dvvfip = 0. The meaning of the brack¬ 
ets is {A, B) = f dvAB such that 


Lip) = / dvip 


kTr'j d ( j. dip 


dv 


^ dv 


f dipkTr-/ dip 

= -j^^^^^dii- 

The approach can be justified by writing ip = ip + i] in 
which case it may be shown that 


I[ip] = I[tp] + ^{r],Lr]), 


(B4) 


as lo ng a s L satisfies {Lip,r]) = {ip,Lr]). It is clear from 
Eq. (B3l that {r], Lrj) for the operator L in question is 
never positive, so the variational principle may be char¬ 
acterised as the maximisation of I[ip], which is achieved 
when Ip = Ip. The value of the functional in such a cir¬ 
cumstance is 

= ^ (V', Lip) -{ip^Z) = -^{ip, Lip)>0. (B5) 


We clearly need to evaluate 
{ip,Z)= f dvip^+ f dvipv^ + 


dx 


- J dvip ^ 


F df 

- jv 


and for the first term we write 

_ dt p 2 Tr dt 
m{v — v) dv m{v — dTj 


dv' 

(B6) 


~df f 
dv '0'^ = dv Ip 


+f 


= dv ipf 


kTr dt 2fcT2 
m{v — v)^ dTr 
2fcT2 di 


dt 


(B7) 


having used / dvfip = 0 and f dvvfip = 0. For the 
second term we get 


dv ipv-J- = [ dv ipv 
dx I 


dx p 2Tr dx 


+/ 


m{v — v) dv ^ m{v — v)'^ dTr 


kTr dx 


2kT^ dx 


. , r , 'mv dv m{v — u)2 dTr 

= / 2kT? Si 


(B8) 


and by similar reasoning the third term in Eq. (B6) 
vanishes. We therefore find that 


~ 1 f dip kTr"/ dip m dTr j 

m = -2 - wtiihI 

i{v — v) dv m{v — dTr 


f ~ ( 

— / dvipvf I - 


kTr dx 


2fcr2 dx 


dvipf{v — 

(B9) 


is the expression that has to be maximised over ip subject 
to J dvipf = 0 and / dvvipf = 0. 

The Euler-Lagrange equation that specifies the optimal 
Ip is 


kTr"/ d dip . f . r m dTr 

-f^ = Mf TMvf - 




-vf 


m dv dv 
m{v — v) dv 
kTr dx 


2/cT2 dt 
m{v — v)^ dTr 
2kT^ l)x 


f{v-v) 


kTr"/ 

m 


dip m{v — v) 
dv kTr 




(BIO) 


where Lagrange multipliers Ai _2 associated with the con¬ 
straints appear. Inserting a trial solution 

Ip = ipo + a{v — u) -I- b{v — -I- c{v — v)^, (Bll) 


we get 


X, + X,iz + v)-^—z 
mz dv ^ mz'^ dTr 


(,kTrdx ' 2 kT^ dx 

m ^ klr 



(B12) 


where z = v — v, and by requiring that the coefficients 
of and z^ be zero together with imposing f dvipf = 
f dvvipf = 0, we obtain 


1 dTr 
2"/Tr dx 


b 

c 


00 


m /I dTr ^dv V dTrP 

AkTr"/ \Tr dt dx Tr dx ) 

m dTr 
6"/kTip dx 

1. n ^ . 2—+ 

47 \Tr dt dx Tr dx J ’ 


(B13) 


which specifies the approximate nonequilibrium pdf p = 
/(I -|- Ip) for transient conditions. If we make the further 
approximations u = 0 and p « pst, this reduces to the 
solution given in Eq. (211. 


Appendix C: Rate of entropy production and 
Onsager’s principle 

We discuss the relationship between the variational ap¬ 
proach to solving the Kramers equation reviewed in Ap¬ 
pendix and proposals for identifying a nonequilibrium 
stationary state based on extremising the rate of ther¬ 
modynamic entropy production. Such a principle has 
been discussed many times before ISSUST]. The version 
that is most appropriate in the present context is the 
maximisation of the Onsager function, the difference be¬ 
tween the rate of entropy production and a quantity de¬ 
noted the dissipation function |25]. In classical nonequi¬ 
librium thermodynamics, the rate of entropy production 
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S'({J^i, Ji}) is given by in terms of currents Ji 

(such as the heat flux or a particle current) and their 
respective driving thermodynamic forces Fi (gradients 
in the inverse temperature field and the negative of the 
chemical potential, respectively). The dissipation func¬ 
tion is defined as ^ ^ FLijJj where the Lij is a matrix 
of coefficients. Maximisation of the Onsager function 

= (Cl) 


the rate of entropy production from a statistical mechan¬ 
ical perspective, valid for transient as well as stationary 
situations, as 


Qs 


dv 


d'lp kTr^ difj 
dv m dv’ 


(C3) 


to leading order in inverse friction coefficient, which cor¬ 
responds to u = 0 and '0^1. Notice that Qs is therefore 
related to the quantity 


over currents Ji for a given set of forces Fi produces 
linear relationships between the two in the form Ji —>■ 
Ji = ^RijFj, where R = L~^, in agreement with the 
phenomenological linear response, and hence provides a 
description of a nonequilibrium state. This has been re¬ 
ferred to as Onsager’s principle and interpreted as the 
constrained maximisation of the rate of production of 
entropy. The maximised value of the Onsager function 
is Ji [namely, half the rate of entropy production 

S'({J^i, Ji}) = 'Y^FiJi\ if it is assumed that such linear 
relationships prevail, and the dissipation function then 
takes the value \ ^ JiLijJj = ^J^FiJi- The formalism 
written here in terms of summations could be taken to 
apply to integrations over spatially dependent currents 
and forces. However, the origin of the dissipation func¬ 
tion and the basis of the variational procedure are not 
altogether apparent. 

Kohler [53] and Ziman [53] noticed the similarity be¬ 
tween the Onsager function 0({Ji}) and the variational 
functional /[0] used in the solution of the stochastic dy¬ 
namics in Appendix [^ and suggested that the latter pro¬ 
vided a microscopic dynamical underpinning of Onsager’s 
principle. However, the latter is clearly founded upon 
a classical thermodynamic viewpoint where the primary 
representation of entropy production is the product of 
forces and currents. In contrast, in traditional statistical 
mechanics and in stochastic thermodynamics the primary 
representation is given in terms of properties of the sys¬ 
tem pdf. We can demonstrate this for the system under 
consideration in this study. By multiplying Eq. © by 
— hip and integrating, we obtain after some manipula¬ 
tion 


dps 91n(l -I- 0) kTr^ dij} jp {F - T) 

dt dx J ^ dv m dv 

(C2) 

where if} specifies the pdf that satisfies the Kramers equa¬ 
tion, and Ps{x) = —f dvplnp and js(x) = — f dvvphip 
can be regarded as the density and current of (dimen¬ 
sionless) mean system entropy, respectively. We de¬ 
fine the local temperature of the system T{x,t) through 
f dv{v — v)^p = p{v‘^ — v'^) = kTp/m. The final term 
in Eq. ( |C2| ) corresponds to a Clausius-style entropy flow 
to the system associated with heat transfer from the en¬ 
vironment brought about by the difference between 
and T. We can therefore identify the spatial density of 




dvip 


kTr"f d 
m dv 



QsW, (C4) 


using the notation of Appendix |B| 

This interpretation may be demonstrated more di¬ 
rectly from the expression for the mean rate of stochastic 


entropy production, d{Astot)/dt in Eq. (lOl. We have 


J(Astot) 

dt 

= / dxdv 


= / dxdv 


pkTr^ 


(4’ 


91n(l-I-0) A:Tr 7 (90 m 

— Wv —ir% + wF’ 


(C5) 


which for u = 0 and 0^1 reduces to the spatial integral 
of qs given by Eq. (C3l. This formulation emphasises 
that qa represents the spatial density of mean stochastic 
entropy production for any function 0 and associated pdf 


P- 

These considerations provide a thermodynamic inter¬ 
pretation of the —(0, T0) term in the functional /[0] but 
they imply an important change in perspective. The vari¬ 
ational principle can also be cast as the minimisation of 
-2/[0] = -(0,L0) -I- 2(0, Z) = 9^(0) -I- 2(0, Z), which 
would then be regarded as a minimisation of the spatial 
density of the mean rate of stochastic entropy produc¬ 
tion gs(0) with respect to the trial function 0, under the 
constraint of a fixed value of (0, Z). By identifying the 
optimal trial function variationally, we are able to deter¬ 
mine the solution to the Kramers equation. As noted 
by Kohler, Ziman and others, such an approach essen¬ 
tially provides a thermodynamic shortcut to solving the 
dynamical problem. 

The negative of the expression (0, Z), when restricted 
to a stationary state with dF/dt = 0 and u = 0, is given 

by 




dTr f ~ mv^ 

-IS 


OXr') 

dx 


dv 


f + ^f 


mv^ 

~W’ 


(C6) 


which is the product of the gradient of inverse tempera¬ 
ture and the particle kinetic energy flux (divided by k) 
at position x, therefore resembling the spatial density of 
an entropy production rate in classical thermodynamics, 
for a trial 0. However, in the context of stochastic ther¬ 
modynamics — (0, Z) is not to be primarily identified as 
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the entropy production, whereas Qs most definitely can 
be so interpreted. 

We have followed Kohler and Ziman in regarding the 
variational procedure used in Appendix as a princi¬ 
ple founded in dynamics (i.e. '0 is selected in order to 
satisfy the Kramers equation) but which is capable of 
a thermodynamic interpretation. However, the appar¬ 
ent thermodynamic principle in operation is not quite as 
clear as has been suggested. The semantic subtlety is 
whether, following Onsager, we must maximise classical 
entropy production ^ J-iJi, subject to a fixed dissipation 
function ^ ^ JiLijJj, over currents Ji for a given set of 
forces Ti, or minimise a stochastic thermodynamic rep¬ 
resentation of the spatial density of entropy production, 
in this case 9 ^( 0 ), with respect to a function 0 subject to 
a fixed (0, Z). The fact that both interpretations can be 
maintained, depending on whether we use a classical or 
a stochastic framework of entropy production, suggests 
that taking a particular thermodynamic viewpoint of the 
procedure should be treated with caution. 


Appendix D: Detailed fluctuation relations 


1. Detailed fluctuation relation for Astot 


The total entropy production associated with a trajec¬ 
tory takes the form 


A4JX] = In 


>Lrt[^( 0 )F^[^(T)|X( 0 )] - 

.pLAXir)]'P^{XHr)\XHO)]\ ’ 


(Dl) 


where X corresponds to x, v and X{t) represents the co¬ 
ordinates x(t),v{t) taken by the system under what we 
shall call a forward protocol of driving, while X^ cor¬ 
responds to with A1 (t) representing (t ), (t) 

where x^t) = x{t — t) and nfyt) = —v{t — t). The 
superscript R indicates driving according to the reverse 
of the protocol that operates in the forward process, 
which is labelled F. The above expression is compati¬ 
ble with Eq. ([^ with P^[£,n] here explicitly written 
as pfj,j,.^[A(0)]7^[A(T)|A(0)] in terms of a pdf of initial 
coordinates and a conditional probability density 

■ Note that the expression takes the form of a ratio of 
probabilities of a trajectory and a (nominal) reverse or 
antitrajectory, the initial pdf of which is ('’’)]! 

pdf of coordinates at the end of the forward trajectory. 
There is an implied inversion [3D] of the velocity coor¬ 
dinate such that X{t) — >■ AlfyO) before the continuation 
with the reverse trajectory XfyO) — ?► Afyr). The pdf of 
initial coordinates for the reverse trajectory is therefore 
determined by the forward process. 

The distribution of entropy production for the forward 
process can be written as 

P^{Asl,=A) (D2) 

= I dXpLrt[^(0)]7^^[A(r)|A(0)]<5(A-A4jX]), 


and this depends on the form taken by the initial pdf, 
and the nature of the prevailing dynamics. 

We next consider the entropy production for a trajec¬ 
tory generated in a process starting from a pdf and 
driven by a reverse protocol. This is 


A^JX] = In 


- pf,,,,[X{0)]V^[X{T)\X{0)] - 


(D3) 


The trajectory shown here is general but it will prove 
fruitful to write X as X^ and therefore related to X, i.e. 
X(0) represents x{t),—v{t); X{t) is a:(0),—n(0); XfyO) 
represents a;(0),n(0) or X(0); and Xfyr) is x{t),v{t) or 
X{t). Clearly this specification of X satisfies the dy¬ 
namics under reverse driving. We have 


As^JX^j = In 


. P?„d[^n^)]^n^(r)|X( 0 )] . 


,(D4) 


and we compute the distribution of total entropy produc¬ 
tion in this process: 


= A) (D5) 

= I dX^pf,,jxH0)]P^[X\r)\xH0)]6{A - A^JX^j). 


Writing Eq. ( |D4[ ) in the form 

pl,jXt(0)]7^i^[Xt(r)|Xt(0)] 

= (D6) 

and noting that dX = dX\ we find that 


P^{Ast, =A) = j dX^ pl,^[X\T)]P^[XiT)\X{ 0 )] 

xe^'--[^^l<5(A-A40Xt]) (D7) 

= e^ I dXpl,^[XHT)]P^[X{T)\XiO)]S{A - Asf^JXtj). 


Now, if it can be arranged that ('’’)] = 

pLrt[^(0)] or and 

PLrt[Al^(0)] = pLd[^(^)] or = Pend[2^W], 

then it would follow that 


As^ JXt] = In 


pl,,,[X{0)]V^[X{r)\X{0)] 


= -AsL[X1 


(D8) 


in which case we would obtain the detailed fluctuation 
relation 


P^iAsl,=A) = 

e^l dXpL,jX(0)]7^F[X(r)|X(0)]5(A + As^fX]) 

= e^P^{Asl, = -A). (D9) 


It is necessary to state clearly what this means. It relates 
the pdf of total entropy production in a forward process 
to the pdf of total entropy production when the system is 
driven by a reverse protocol instead, with the condition 
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that the initial pdf for the reverse process is a velocity 
inverted version of the final pdf in the forward process, 
and similarly the initial pdf for the forward process is a 
velocity inverted version of the final pdf from the reverse 
process. We have essentially followed |3] and [3S] in this 
derivation. 

A single system can be subjected to a forward and 
reverse process sequentially such that r;] = 

condition for the detailed fluctuation 
relation to hold would then require the pdf at the end 
of the forward sequence to be velocity symmetric. For 
a system driven by a repeated sequence of forward and 
reverse processes, u] = would apply as 

well, implying velocity symmetry in the pdf at the end 
of the reverse sequence. Furthermore, if the forward and 
reverse protocols are identical, which requires each to be 
symmetric about the midpoint in the interval, the con¬ 
dition for the validity of the detailed fluctuation relation 
requires the initial and final pdfs to be the same, in which 
case Eq. (D91 would reduce to 


P(Astot) = P(-Astot), 


(DIO) 


for such an interval, which is the detailed fluctuation re¬ 
lation that is tested in Section m The required velocity 
symmetry of the pdf at the beginning and end of the 
interval does not hold in general, and indeed is not sat¬ 
isfied by p{x,v,t) in Eq. (21) for the particular system 
we have studied, but for large 7 the asymmetry is small 
and in such circumstances Eq. (DIOI will apply to an 
approximate extent. 


protocol. This is 

Paart[^(0)]7^^[^(T)|^(0)] ' 


Asf [X] = In 


(D13) 


Once again we represent X as i.e. A(0) repre¬ 
sents x{t),—v{t), or TX{t); X{t) is x(0),—u(0), or 
TA(0); A^(0) represents a:(0),—u(0), and also TA(0); 
and X^{t) is x{t), —v{t) or TX{t). We write 


pl,jfxiT)]r^[fxmTxiT)] 

pfUTXmV^^[fX{r)\fXiO)] 


■ (D14) 


Now, if it can be arranged that = 

PLd and 

P^nd['^^(0)] = pftart[^(0)] OT = Pftart[a^W]; 

together with r^^[fx{T)\fX{0)] = [X{t)\X(0)] 

and V^[fx{0)\fx{T)] = r^^[X{0)\X{T)], certainly a 
demanding set of conditions, then we would be able to 
write, using A^(t) = A(0) and A^(0) = X{t), 


Asf [X^] = In 


PLd[^(^)]^a^d[^^(^)l^^(0)] ' 

. pLrt[^(0)]^^[A(r)|X(0)] _ 

Asf[X]. 


(D15) 


We compute the distribution of relaxational entropy pro¬ 
duction in the reverse process in these circumstances: 


P^{Asf = A) (D16) 

= I dx^pl,,,[xHo)]r^{xHr)\xHomA-Asf[x^]), 


2. Detailed fluctuation relation for Asi 


We can perform a similar analysis to find conditions 
for which the relaxational entropy production satisfies a 
detailed fluctuation relation. We start with the definition 

[iniisi 


Asf [X] = In 


' pLrt[^(0)]7^^[^(r)|X(0)] - 

.Pe„d[^W]^a^d[^''(^)l^''(0)]J ’ 


(Dll) 


and writing 

pSart[^nO)]^''[Wt(r)|Xt( 0 )] 

= pf,,,,[fxiT)]r^[fxmfx{T)] 

= pLAXir)]V^AX^iT)\X^m 

= pLrt[^(0)]7^^[A(r)|X(0)]e-^^"l^l, (D17) 

which employs several of our assumptions, and also using 
AsR[X^] =-AsH^], we find that 


where X^ corresponds to with X^(t) represent¬ 

ing x^{t),v^{t) where x^(t) = x(t — t) and v^{t) = 
v{t — t). Introducing further notation, we have X^(f) = 
TXl(t) where T is an operator that reverses the sign 
of velocity coordinates such that Tx = x and Tv = —v. 
The subscript ad indicates that the trajectory X^ is gen¬ 
erated according to adjoint dynamics, to be discussed 
shortly. The distribution of relaxational entropy produc¬ 
tion for the forward process is 


P^iAsf = A)= I dX pl,jXiO)]P^[X{r)\XiO)] 
xe-A4Wj(^ + Asf[X]) (D18) 

= e^l dXpl,,,[XiO)]V^[X{r)\XiO)]S{A + Asf [X]), 
and hence obtain the detailed fluctuation relation 

P^{Asf = A)=e^ P^(Asf = -A). (D19) 


P^(Asi=A) (D12) 

= I dXpLrt[^(0)]P^[A(r)|X(0)]5(A-Asi[X]). 

Next we consider relaxational entropy production for a 
system with a starting pdf driven by a reverse 


This relates the pdf of relaxational entropy production in 
a backward process starting from to the pdf of re¬ 

laxational entropy production when the system is driven 
by a forward protocol starting from pftart) subject to the 
assumptions made about the relationships between initial 
and final pdfs and the normal and adjoint dynamics. 
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For this fluctuation relation to apply to the case of a 
single system driven by a sequence of forward and back¬ 
ward protocols, we reqnire ^ eqnal and 

to equal p^^- Bearing in mind the reqnirements placed 
on the pdfs, both pf^^rt p^art shonld be velocity sym¬ 
metric, as we fonnd when considering the total entropy 
production, and this will hold to an approximation for 
large 7 for the system we consider here. 

The conditions Vl^[fX{T)\fX{Q)\ = [X{t)\X(0)] 

and V^[fX{0)\fX{T)] = iPf^[X(0)|X(r)], or in more 
compact form Vad[TX'\TX] = P[X'|X], can also be jns- 
tifled for large 7 in this system. Adjoint dynamics are 
constrncted from normal dynamics in order to preserve 
a stationary pdf pst bnt to reverse the probability cur¬ 
rent Enmisni. In general, if normal dynamics corre¬ 
spond to the SDEs dxi = Aidt + BidWi for dynamical 
variables then the adjoint dynamics are described by 
dxi = Af'^dt + B^dWi [ 12 ] with 


Af 


ad 


-A, + 2 ^+ 2 A 

ox. 


5 In Pst 
dx^ 


(D20) 


or dx = Vdt together with 


dV 


—^Vdt + 



m 


2kT^j 

m 


1/2 


dW, 


(D24) 


where V = —v. Comparing with the SDEs for the nor¬ 
mal dynamics, it is clear that to order 7 “^ the velocity 
inverted coordinates evolve under adjoint dynamics in 
the same way that the original coordinates evolve under 
normal dynamics (the change in sign of the noise term is 
irrelevant). This is precisely the meaning of the condi¬ 


tion Ve,d[TX'\TX] = P[Ai'|A ] and we conclude that the 
detailed fluctuation relation (D19l should hold for large 
7 . It follows that if the forward and reverse protocols are 
identical then this relation becomes 


P(Asi) = e^®i P(-Asi), (D25) 


which is the detailed flnctnation relation that is investi¬ 
gated in Section EYi 


3. No detailed fluctuation relation for As2 


where Di = ^B^. We note that for normal dynamics 
given by dx = vdt and 


dv = —'jvdt -\ - dt + I - — I dW, (D21) 

m \ m J 


corresponding to A^ = v, = 0, A„ = —jv + F/m, 
Dy = kTr^/m, andpst oc [1 -|- 0{'-f~^)]exp{—mv^ /2kTr) 
according to Eq. (22 1 , then A^'^ = —v and 


.„ri F 2kTr"f mv F 

A^^=jv -77^4-0(7 )«- 7 n-. (D22) 


m m 


kTr 


The SDEs for the adjoint dynamics are therefore dx = 
—vdt and 


, , F , f2kTr-f 

dv « —"fvdt - dt + - 

m \ m 


1/2 


dW, (D23) 


The principal component of honsekeeping entropy pro¬ 
duction UHldS] takes the form 


Asl[X] = In 


P^[X(r)|A( 0 )] 

Pf,[AT(r)|AT(0)] 


(D26) 


where corresponds to x^,v^ with X'^{t) represent¬ 
ing where x'^{t) = x{t) and = —v{t). 

The snbscript ad once again indicates that the trajec¬ 
tory in question is to be generated according to adjoint 
dynamics. 

The denominator in 


Eq. (D26) may be written 


'P^^\TX{t)\TX{Q)\ and for small 7 “^ we saw previ¬ 
ously that for our system this is approximately equal to 
P^[A(t)|A( 0)], which appears in the numerator. The 
approximations that support the validity of detailed fluc¬ 
tuation relations for Astot and Asi therefore snggest that 
As 2 vanishes, giving ns reason not to expect a detailed 
fluctuation relation for As 2 and to nnderstand the con¬ 
trast between Fignres and 
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